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I’ Program Desc 


Bilingual-Bicultural Progra” at C.S. 77 in District 12 
Central Bronx, N.Y.) was designed to provide remedial in- 
stryction in oral English to a specially selected group of students 
grades 1-6 using a group of specially trained educational assist- 
arits. The participants were to receive instruction in the basic 
skills of listen ng and speaking for the purpose of attaining auto-— 
matic control ond fluency jin oral English. It was expected that stu- 
dents participating in the program; who core from severely economi- 
cally deprived npnes, woul benefit from instruction in English by 
carrying their dehy developed exile into content subject areas, 
especially mathematics, social studies, and science where low levels 
of oral English fluency can be handicaps to subject mastery. It was 
expected that the students participating in the program would sieve 
op an appreciation of their cultural background through contact with 
instructional personnel who ave biLinguals 
The Language Assessment Battery for rating a student's ability 
to eran English was used to Heaeenatie eligibility for participa- 


tion in the Bilingual- Bicultural program. Those stude s who scared 


below the 20th percentile on the LAB were eligible ‘i the eran 


-Prom a total enrollment of 2,221 students, 398 have een identified 
by the LAB as being below the 20th cuvunntl tue From this group of 
398 students, a group of 168 students were selected for participa- 
‘tion in the project. Twenty, eight student from each of the six 
grade levels in the school were identified as the target populgt 


who were to receive the special servites of this project. 
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Each student participated on a daily basis, working with the 
educational assistants during regular instruétional periods. The 
educational assistants worked with individual students and with 
groups of two to four students. Their tasks included helping stu- 
dents learn the siouretunal patterns of both oral and written Eng- - 
abel recognizing, sound-symbol relationships in English, and com 
paring word order in Enelish and Spanish. The assistants. used a va- 
riety of means to accoprlish these tasks, including text books, the 
facilities of a’learning, audio-visual aid, small group discussions, 
ihdividual tutoring, and field trips designed to enhance the lang- 
‘uage skills. the participants were developing. The educational as- 
sistants also assisted-in the peetine and diagnosing of the students, 
assisted in maintaining student. records, assisted the teaching arate 
in the selection of appropriate cultural materials, and translated 


materials ‘whenever necessary. The outcome of these activities were 


/ 
/ 


expect to be reflected in student per! formance on the LAB post- abe 
Ry 


/All students were oa ‘tga eX Rabe venkat Battery prior 


tofentering the program and again during the month of April. It was 
expected that students would raise their pretest percentile ranks at 
least ten percentile ranks on the post-test. The program was in oper- 
ation from 9/1/75 and will i i through the end of-the school 
year. { 
The specific objectives of the project, as they were originally 
developed weres . 
1. Sixty-five percent of. the target population in grades 1-6 
who scored below the dutoft score in the Language Assess- 


ment Battery and tient 70% or more of the program sessions 
n s 
6 


the programe as deweribed in the proposal and any subse- 
° | £ . 


_the ‘ie attending 70% or more of the scheduled program 


grade 2 as measured by+the Stanford Early School Achieve- 


‘quent modifications or addenda. 


. ‘ ; ye wg 
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would advance. from Category 2 to Category 1 as measured . 
by the LAB. 


Fifty percent of lene zrade 1 and grade 2 participants in 


rt 


sessions would improve in reading ability from grade 1 to 


ment Test. 

Sixty percent of the pupil participaats of grade 3 to 6 in- 
clusive, attending '70% or more of the s¢heduled sessions, 
would achieve mastery in: '7 of 12 Prescriptive Reading In- 
ventory reading behavioral objectives, that they were de- 
ficient te tunon entry into the program, . 


The’ programs, as actually implemented, would coincide with 


the programs as described in the proposal and any subse- 


/ 
! * ; , . a 
: ’ 


10/15/75. the following changes in objectives were approved: 


siWhy rive percent of the target population in erades 1-6 


‘who "scorned at or, below the 20th percentile on the English . / 


. version of the Language Assessment Battery, and attended 


70% or more of the program sessions would advance ten per- 


centile ranks as measured, bv the Language Assessment Battery. 
‘ : 5 3 : ; 


Eliminated 


Eliminated 


é 

: 
The programs, as actually implemented, will coincide with - 
. + pus 


~ . 


quent modifications or addenda. . e 


~ 7 


B/E Punction #20-63412 
4 

These changes were made because the project staff thought that 
a greater emphasis on the acquisition of language competency would 
i-were benetictal to student participation in the project. The re- 
“sources ot the project could most effectively be channeled into this 
area, rather than atfempting to stretch thin their resources by try- 
ing to cover too many goals. In addition, changes in the Language 


Assessment Battery dictated that percentiles rather than categories 


be used as data points. 


Evaluation Procedures 
Evaluation Sideatine #15 Te determine whether sixty-five percent of 
the target population who scored below the 20th percentile on 
the LAB cookin ake who attended 70% or more of the sessions 
advanced ten percentile ranks on the LAB post-test. . 
1.1 Subjects: Those target students who attended at least 70% 
of the program sessiona were the treatment group. 
Methods and Procedures: The Language Assessment Battery was 
given to students to determine their eligibility for the 


program prior to the start of the program.:It was admin- 


istered a& a post-test’to all program participants in April 


1976. Attendance data were used to identify students son 
whom exte analyeue were computed. The project coordinator 
aneewnaee the sree and post-test Emel Ge on.forms pro- 


vided by the evaluator. 
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1.3 Data Analysis: The post-test percentile rank was compared 


@ | 


to ‘the pretest percentile rank to determine if the 10 per- 
centilé rank increase occured. A distribution of these 

Re teneriba scores is presented to determine the percent of 
students who. progressed 10 or more ir The molest ob- 

jective will be successfully satisfied if 65% of the stu- 

dents show this progress. : 3 q 


Evaluation Objective #2 


The evaluator was to observe program activity, conduct interviews, 


‘and examine ‘pertinent records to determine the extent of congruence 


between program proposal specifications and the actual implementa- 
tion of the proeram) these data are included summarily in the final 
evaluation report. | | 

_ The evaluator observed activity and interviewed key personnel 
to determine strengths and seaknewase wt the program in.order to 
provide dunuiaeidavlons for recycling, planning and staff develop- 
ments these data are provided summarily in the final ev luation re- 
port. ‘3 . . 
In order to carry out the evaluation objectives,. the evaluator 
visited the project site, met with the sraduet director, coordina= 
tor, educational assistants, and students. Teaching staff working 
with thie assistants wank ‘Siveerviowed. as were the’ parents of several 
atanta participating in the project. On-site avaluation visits 
‘were made gn March 18, March 50, April 8, and May 3, 1976. Pre and 
post-test scores were collected on May 24, the date on which the: 


last on-site evaluation was conducted. . 
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Chapter III 
The Findings 
; \ 
The results of the evaluation activities are presented in this 
“section following the format described in the preceding chapter, The 
two major evaluation objectives and the findings germane to each are 
shaiented tia capwnein. . 


pS 
fa 


Evaluation Objective #1: Sixty-five percent of the target poriiletion 


in grades 1-6 who scored ‘at or below the 20th ‘percentile on the Eng- 


lish version of the Language Assessment Battery, and attended 70% or 


more of the program sessions would advance ten percentile ranks as 


measured by the Language si aaa Battery. 

ta ‘The first component a te objective van to determine how many 
students participated in at least 70% of the scheduled sessions. At- 
tendance data and other information provided by the project conduc-. 
tor weré evaluated to obtain these data, Table 1 contains a frequency 
_ distribution of the number of students at each grade level who met 


the’ 70% criterion, as well as distributions for those who did not. 


As can be seen, 148 students out of the targeted 168, completed the 


activities of the project. This represents 88% of the original group. 


Only.12% of the original group were not incladed in the data analyses 
that are presented below. Of the 20 students who were not included in 
the analyses, 11 were discharged from the project because they moved 
out of the ares served ‘by the school late in the school year ( primar- 
.ily in March and April). Three students were absent from-school on 


the dates the LAB had been scheduled. They also were absent,on the 
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Table 1 
Prequency Distribution by Grade Level of Participants 


Who- were Discharged, At@ent, and Tested at Termination 


of Project 
} . 
Grade , Discharged Erroneous Data . Absent Tested 
1 : , 1 29 
2 2 26 
3 2 , 1 ; 25 
4 1 3 "2k 
5 2 1 ae: 24 
: 6 4 ; 2 "es 22 
' Total 11 6 eS 148 


11 


Language Assessment Bathery Percentile Ranks Tables developed at the 
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dates scheduled for make-up testing. Test data for six students were- 

not included in the final analysis because the project staff believed 
that the pretest scores were spuriously inflated and thus could not . 
meaningfully be cqmpared to their post-test scores. These six stu- | 
dents scored at or above the 20% on the pretest, even though they 
denonvtratedyvery poor language. skills in non-test settings. It was. 

the judefent of the staff that these students be allowed. to partici - 
pate.in the project even though’, through some quirk, they exceeded 


the pretest cutgff scores. Over 75% of. the students designated as 
&, . 


eligible for participation at each grade level are included in the 


' final data analysis. 


In order to‘ determine if the first project objective, that 65% / 
of those students attendin®? 70% or more of the scheduled sessions’ | 


gained ten percentile ranks‘ on the LAB post-test, the LAB post-test 


_ percentile rankings for each student were compsred to their respet> 


tive LAB pretest percentile rankings. The amount of gain was tabu-, 


‘lated to determine if the anticipated gains had been achieved. The 


results of these comparisong are presented in Table 2. The first 


column of that table indicates the number of percentile ranks “gained. 
, : / 


The range is from no gain, for those students, whose scores did not 
change, to a high of 21 points, for those students: whose- post-test 


‘score was above the highest percentile ranking provided in 1976 


central board. The second cotumn of ay 2 2 contains the actual num-' 


ber of students who gained the specifie€ number of percentile ranks. 


Z 


Column 3 contains the percent of students who achieved specific gains 
a 


and column 4 shows the cumulative percent of specific points gained. 
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Table 2." : a — 


Prequency Distribution. and Fercent, Distribution of: Gains 


on the Language a al Battery Post-test 


/ 


¢ . hoo, 
Points Gained wun eX | > “Percent ‘Cumulative. 
° we ' it Percent ‘ 
21- 24 . 162 +998 e 
19 - 20 25 6168 836 
—~A17°>~ 18 ‘4 006 668 : 
; 15 + 16 1 006 662 
ts i ra ? © 4047 2656 
tl = 12 ; 11. 07% 609 
9-10 1 006 ©535 
| 2. Pa 8 6 = 042 +529 
| 5- 6 12 F , 082 487 
| . pe 4% 10 ~ 06? «405 . 
2 1- 2 12 .082 +338 
No gain 38 2256 0256 
| 
. Total 148 ; 
«. . 
e 
: 3 
4 . | | 
. , 
‘ 13 | 
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As can be seen in Table 2, 52.9 percent of the participsnts 


gained fewer than 10 percentile ranks, thus the project objective 

of 65% achieving atcleast 10 points was not met. Inspection ofthe 
table shows that 25.6% of the participants did not show any gain, 
whereas 338 gained 19 or more ranks. a! Thus the results are to 
some extent bimodal ‘with large numbers of students, gaining well be- 


. yond. project expectations, and’ a smaller, though large, EREer net 


7 realizing any ‘gain, Pourteen percent of the group gained. between ‘10 


and 19 points, and 27,38 gained between one and nine pointe, . 

In order id Clarify the results of these results, an additional 
comparison was made. Since the criterion for placement: in the project 
was a score below the 20th pergentile, an indicator of ‘the success of 
the project would ‘be the number of students whose post-test score was 
above the cut-off. This information. is needed since a gain of only a 
few points on the post- -teat may be sufficient to. put a student above ' 
the cut-off. For example, a student whose percentile score on ‘the Z 
pretest was 15, needed to gain only 6 points to go above the cut-off, 
and also to go above the tabled data of ‘percentile: euicuianiic: His 
gain, while ‘aie the expected 10 poi Lal would be a real gainy as it 
demonstrated a higher level of Englis language competence, the data , 
in Table 3 ghow by grade level, tre number of students who scored at 
or above the 20th percentile on the LAB. post-test. a e 

A total of 62 students, representing’ 426 of the total group, 
reached | the cut-off level. As. can be seen,.there were wide discrep- 
ancies between. grade Levels with the highest proportion achieving ; 


this level at the firet grade, followed by the second grade. For the. 


—— grade leveis many fewer students reached the cut-off saa 
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Table 3 . 
a . 
‘Number and Percent of Students Who Scored above the 


20 Percentile on the Language Assessment Battery 


Post-test. 
Grade ; Number "Percent 
1 24 88 
le 2 15 57 ; 
3 vj ; +28 
4 ? +29 
5 2 08 
6 o | +32 
z ; a 
Total 62 42 | 
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‘These results indicate that early intervention may be much more ef- 
fective-than attempts at higher levels; and suggest that, if ex- 
pected results are to be achieved ith older students, a more in- 
tensive program will have to be developed. 


The results of the analyses for the first objective indicate. 


a . ’ 
{rat the overall objective was not successfully met, as only 47.1% 


of the target group achieved -at the expected level. This finding 
must be tempered by the finding of wide discrepancies hetween classes, 
sfnce the first and second grades exceeded the expectations of the 


project. 


Evaluation Objective #2: The programs, as actually implemented, would. 
coincide with the programs as described in the proposal and any sub- 
Bequent modifications or addenda. . 

Based on interviews and observations, it was found that the 
educational assistants functioned in all of the activities contained 
in the original proposal, Their work was coordinated by the TESL 
professional who functioned as project coordinator. Each assistant 
followed a schedule worked out by the ¢oordinator. The gchedule was 
developed wes at sontecenced held with the coordinator. At these 
confergnces, discussions of each student's progress were held, and 
work planes for the following week were Aevetoc Senet on several 
observations, it~can be said, without hesitation, that ‘the assistants 

ere fully Suvateud in the activities of the Bro JWet. stile worked 
exclusively with one class and spent their time, tutoring, working 
- with small groups, and monitoring student progress. One ansintare 


wag assigned to a Learning Center where she worked on “language skills 


Pe 
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throygh reading instruction. Her work was closely supervised by 
both the TESL and Cente professionals. Another assistant was as- 
signed to The Gallery which is/a multimedia science, art, arid photo- 
graphy laboratory. The reraining assistants moved from class to 
class working with target cXildren ‘in their home classes or in the 


TESL room. : hs er se & | 


x 


The’ major strength of the project is the close cooperation that 
existe between the asaistants, teachers, administrators, and students. 
The assistants are essential staff members, not viewed as auxillary 
staff. Each of ‘the ac ivites designated for the assistants, such as r 
planning, testing, record keeping, translation services, jena carried 
out at a hieh level of competente. Schedules were always available 
to the evaluator, even with no notice of a visit, so that es assist- 
ants. could be shania in their works test an¢ attendance data were 
always up to date; and in-service activities ware carried on weekly. 

. Prom the evaluator’ 8 point of view, whe project successfully * 

‘met this second shiective witha high degree of rivctbuacavn — 
efficiency. While the expected test gains were not fully achieved, 

“sthe project seems, definitely to be providing a very valuable service 
to children sho vied extra help in developing English language com- 
petence. The facilities in which the project functions, ‘especially . 
the TESL room, Learning Center, and Gallery are very appropriate, 
and facilitative for learning. The materials used, Snelutithe cone so 
\mercially aedaioped and etaff developed, were stimulating and geared 


‘very specifically to the needs of the individual youngsters involved 


* @ 
\ 


in the project. 


\ 
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Chapter IV 
Summary of Major Findings, Conc}usions, and Retommendations 
’ j ’ . * 
/ 


This report presented the Scale evaluation of the Bilingual~ 
Bicultural Program in C.S. 77, Pistpict 12, Bronx, N.Y. The project 
was designed to increase ‘the af es English language comprehension 


of elenertary, school age children who were found to be. “below a cut- 


off score on the Language Assessment Battery. Ten ‘educational assist-. 


ants worked ipEely with 168 target youngsters in activities that 
ranged from individualized instruction, to small-group work, to 
testing, diagnosing, and prescribing interventions, The primary goal 
of these activities was to bring each participant to a higher level 
of competence in using and unddratanding English. The findings of 
this evaluation were that the nd jor goal was not fully realized, in 
spite of aus well coordinated, -highly woredenns effort on the 
part of project staff membera. 

The major findings were that ards 47.1% of the students parti- 
gipating in the project gained the expected 10 percentile ranks , 


needed bi satisfy the project objectives. The ~~ was that 65% of 


‘the participants would achieve these rains, thus the project fell 
; short of its goal Wy 17.9%. The fiethods used to calculate these data, ~ 


however, must * considered when interpreting these res ts, It must 


be borne in sae first of all, that the tables of pereentiie equiv~ 


ilents did not show percentile scores ‘above the 21st percentile, 80 


that students who had pretest scores above the 12th percentile, . 


could not show the expected gain. This, in fact, occured, for about 


13%0f the participants, so that the percent of “successful® pineal 


18. = 


~ 


pants may actually approach eas aeatins han 47%. As was shown in 
a 


‘|Table 3, 42% of the group scored abov@ the 20%ilp, and thus no 


longer qualify for inclusion in the frvbnst ee it was ta ‘ 


at hieher ee levels, sugcentihe that early beatin is the 
most eftetive was of aia: oungsters, develop competence in 
sia English. 


An alternative intergretation to. the early intervention recom- 


mendation would “be to aflocate moreséf the resources ‘and staff: of the 


ptaff of ‘the project with fourth through gixth grades, since they are 
in greater need of large scale intervention. If these youngsters are 
to grasp the requ ite’ English language skills before progressing-on 
to secondary schools, a more intensive program will have to be devel- 
oped for then . 
In terms of project management and implementation of the program 
described in the proposal, it wae found that this aaa excellent 
| program. All of the activities outlined were carried out at a high 
level of efficiency and. competences Staff relations, training. pro- 
cedures, and instructional scibitetiien were all implemented ina 
highly professional manner, The coordination activities of the “TESL 
professional were executed in a very competent savsier as was the 
overall supervision provided by the building administrator who served | 
as project director. - | 
. It can be concluded that, while felling shart oe ite intended 
goal, this project has been effectively implemented, and was at. 
‘ least partially successful in meeting its major goal. Based, on this 


. evaluation, it is ‘recommended that the project be continued next 
é ; é . 
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year, with some modifications. These modifications are made below 
' 3 « 


in the realization tMat. fiscal realities may prevent their imple- 


. 


a . 


{ mentation. 
1. Greater emphasis be placed sat the fourth, fifth, and sixth 
‘grade levels so that-more of these students can obtain a 
higher level of*‘proficiency in spoken English. : 
‘2s The TESL professional be given more time to coordinate and 
‘ ; sapervied.the assistants, and also dbe available to dévete 
ae & a more time to highly individualized nfeacetotive activities | 
| | with students who scored below the 10%ile on the LAB. The 
i+ combined efforts of the’ TESL professional and assistants 
‘, may result in a higher percentage of students a okadning the 
desired ‘goal. ; 
3.- Since reading is a key to grasping laneuage skills, the NYC 
Reading test scores should. be included in any future evalu- 
ation. The effects of the project treatment BAY show them- . 
weve in higher reading scores. 
&, A. more complete technical manual be prepared.for the LAB so 


that percentile. scores beyond the 21% can be. computed and Vey 


used in evaluating project outcomes, 


# aes =. 


